Reliable and unreliable dynamics in driven coupled oscillators 
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This letter concerns the reliability of coupled oscillator networks in response to fluctuating inputs. 
Reliability means that (following a transient) an input elicits identical responses upon repeated pre- 
sentations, regardless of the system's initial condition. Here, we analyze this property for two coupled 
oscillators, demonstrating that oscillator networks exhibit both reliable and unreliable dynamics for 
broad ranges of coupling strengths. We further argue that unreliable dynamics are characterized by 
strange attractors with random SRB measures, implying that though unreliable, the responses lie on 
low-dimensional sets. Finally, we show that 1:1 phase locking in the zero- input system corresponds 
to high susceptibility for unreliable responses. A geometric explanation is proposed. 



For a dynamical system, the question of reliability can 
be formulated as follows: if an external stimulus is ap- 
plied multiple times, will it elicit essentially the same re- 
sponse each time independent of the state of the system 
when the input is received? The answer is fundamental to 
the ability of the system to encode stimuli in a repeatable 
way. It also determines if an ensemble of such systems 
would synchronize if they receive the signal as a common 
input. Applications range from biological pacemakers to 
laser arrays to neurons processing incoming stimuli 1]. 

The reliability of isolated oscillators has been explored 
extensively in both experiment and theory. For example, 
single neurons respond reliably to fixed-current signals 
in laboratory experiments 2] . Theoretical studies j^, 
have shown that reliability is typical for phase oscillator 
models, i.e. ODEs on the circle. Unreliable dynamics, 
characterized by an apparently chaotic response to the 
stimulus, have been shown to occur if the state space 
of the oscillator has more than one dimension and the 
stimulus is sufficiently strong 5]. 

The reliability of networks of coupled oscillators is far 
less well understood. Here, we take a first step toward 
understanding how input stimulus and network architec- 
ture interact to determine reliability. For concreteness, 
we focus on a 2-oscillator pulse-coupled network. 

Our main findings are: (1) Single oscillators that 
are reliable in isolation can become highly unreliable 
when coupled, depending on input amplitude and cou- 
pling strengths. (2) Strange attractors with random SRB 
measures are a signature of unreliability. The singularity 
of these measures implies that even in unreliable dynam- 
ics, phase relations are highly structured. (3) Parameters 
at which the two-cell network is especially susceptible to 
producing unreliable dynamics coincide with the onset of 
1:1 phase locking for the system with zero input. Geo- 
metric explanations for some of the observed phenomena 
are proposed. 

I. THE TWO-CELL MODEL 

We consider in this letter a 2-cell network of oscillators 
with the following structure: 



To illustrate our ideas, we use a standard phase model 
which characterizes the dynamics of limit cycle oscillators 
with smooth, pulsatile interactions 0: 



9i=u;i+afkg{02)z{0i)+ez{ei)I{t) 
92=uj2 + asg{0i)z{e2), 



(1) 



The state of each oscillator is described by a phase, i.e., 
an angular variable Oi G = R/Z, z = 1,2. The con- 
stants uji and UJ2 are the cells' intrinsic frequencies, I{t) 
is the external stimulus and e its amplitude. In this let- 
ter I{t) is taken to be white noise. The coupling is via a 
"bump function" g which vanishes outside of an interval 
{—b^b); we have taken 6 to be ^ 0.05. On {—b^b)^ g is 
smooth, it is > and satisfies J_^g{0) dO = 1. The 
meaning of g is as follows: We say the ith oscillator 
"spikes" when Oi(t) = 0. Around the time that an os- 
cillator spikes, it emits a pulse which modifies the other 
oscillator. The strength of the feedforward (ff) coupling 
is given by ( "forward" refers to the direction of stim- 
ulus propagation), and likewise for afb, the feedback con- 
nection. Finally, the response of an oscillator to coupling 
and stimulus is modulated by its phase response curve 
z 7, 8]. We take z{0) = ^(1 — cos(27r^)), characterizing 
oscillators near saddle-node bifurcations on limit cycles 
(as for many neuron models 

The simplest way to investigate the reliability of a sys- 
tem is to carry out many simulations, using a different 
initial condition each time but driving the system with 
the same stimulus e/(t), and to record spike times in 
raster plots. Fig. 1 contains the results for cell 1 for two 
distinct sets of connection strengths. On the left is the 
feedforward case, with = 1 and afb = 0: After a brief 
transient, every trial {i.e. every initial state) evolves to 
produce identical spike times. This is a signature of reli- 
ability. With afb = 0, the presence of cell 2 is irrelevant; 
our results are thus consistent with 0, Q . On the right 
is the positive feedback case, where aff = 1 and afb = 1.5: 
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FIG. 1: Raster plots. In each experiment, the results of 75 trials are shown, and dots are placed at spike times of cell 1 (with 
each trial corresponding to one row). Left: feedforward network (as = 1, afb = 0), exhibiting identical spike times or reliability. 
Right: Positive feedback (aff = 1, afb = 1.5) with unreliable responses. 



The plot shows that even though some spiking events are 
shared, there is no convergence to common spike times. 

II. RANDOM ATTRACTORS 

With I{t) taken to be realizations of white noise, we 
treat (^) as a stochastic differential equation (SDE), and 
its solutions as random dynamical systems (RDS). We re- 
view below some relevant mathematical facts and discuss 
their interpretations. 

Review of RDS theory [9]: Consider the SDE 

dxt = a{xt) dt + h{xt) dBt , (2) 

where Bt is a standard Brownian motion. We assume 
that the steady-state statistics of Xt are governed by a 
stationary probability measure ji which has a density (/i 
can be found by solving the Fokker-Planck equation). By 
a very general theorem, the solution of Q has a repre- 
sentation as an RDS: Associated with almost every sam- 
ple Brownian path c<; is a family of diffeomorphisms (i.e. 
smooth invertible transformations) of the phase space 
{Fg^t;^,5 < i} with the property that for every point 
X in the phase space, if Xg = x^ then Fs^t;uj{x) = Xt gives 
the solution to the SDE at time t. 

Thinking of the process as starting from t = — oo, we 
obtain a family of sample measures {fiu} which are con- 
ditional measures of /i given the history of the Brownian 
path up to time 0. That is, /i^ describes what one sees 
at t = given that the system has experienced the per- 
turbations defined by the realization of Brownian motion 
a; for t < 0. This property can also be expressed by 

(^-t,0;a;)*M ^ Mo; aS t ^ OO (3) 

where (F-t,o;a;)*M is the measure obtained by transport- 
ing /i forward by F_t,o;a;- Finally, the family {fioo} is 
invariant in the sense that (i^o,t;a;)*(Ma;) = f^atiu) where 
at{uj) is the time-shift of the sample path co by t. 

Interpretation: For us, Xt = (6>i(t), 6>2(t)), our phase 
space is x S^, and each uj corresponds to a stimulus 
I{t),t G (— oo, oo). If our initial distribution is given by a 
probability density p and we apply the stimulus e/, then 
the distribution at time t is (Fo,t;a;)*P- For t sufficiently 
large, one expects in most situations that (Fo,t;u;)*P is 
very close to (Fo,^;a;)*M, which by is essentially given 



by Patiu;)' The time-shift by t of is necessary because 
by definition, ja^ gives the conditional distribution of /i 
at time 0. 

Fig. 2 shows some snapshots of (Fo,t;a;)*P5 which, in 
the latter panels (where t:^l)^ approximate Patiuj)- The 
initial density p (prior to the presentation of el) is the 
steady state of the network under weak (amplitude 0.01) 
white noise ^s in Fig. 1, results for two distinct 

cases are shown, feedforward in the top row and positive 
feedback in the bottom row. 

Two relevant results: Lyapunov exponents (LE) 
measure the exponential rates of separation of nearby 
trajectories in a dynamical system 11]. The value of the 
largest LE, Amax, contains a great deal of information 
about the system: A positive Amax for a large set of tra- 
jectories is synonymous with chaos, while the presence 
of stable equilibria is characterized by Amax < 0. As in 
deterministic systems, LE for RDS are well defined, and 
they are nonrandom^ i.e. they do not depend on co. 

THEOREMS. The setting is as above; p has a density. 

(1) (Random sinks) |l3 ^/Amax < 0^ then with proba- 
bility 1, puj is supported on a finite set of points. 

(2) (Random strange attractors) 13] // Amax > 0^ 
then with probability 1, p^j is a random SRB measure. 

SRB measures are special invariant measures that de- 
scribe the asymptotic dynamics of chaotic dissipative dy- 
namical systems. They live on unstable manifolds, which 
are families of curves, surfaces etc. that wind around in 
a complicated way in the phase space [lH. 

Consequences for reliability and unreliability: 
Since reliability means the system's reaction to a stimu- 
lus is independent of its initial state, it corresponds to a 
random fixed point, or Amax < 0, as observed in 0,0- 
Complicated sets generated by unreliable dynamics have 
also been numerically observed before |5|]. We point out 
here that the characterization of unreliable dynamics by 
SRB measures has two important consequences. First, 
the very distinctive geometries of random sinks and SRB 
measures provide a dichotomy between reliability and un- 
reliability that is easy to recognize in simulations (see 
Fig. 2). Second, because the p^ are singular (even though 
p has a density), different initial conditions are attracted 
to a low-dimensional set that depends on the stimulus 
history. This implies that even in unreliable dynamics. 
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FIG. 2: States of 50, 000 initial conditions evolved for 1900 units of time. Snapshots at various times of sample measures in 
response to a single realization of the stimulus are shown. (Top) Feedforward network: the states converge to a random fixed 
point. (Bottom) Feedforward network: the states converge to random strange attractor. (Far right) Number of grid elements 
in a 30 X 30 grid needed to cover 90% of the trajectories are plotted as a function of time; it shows in particular that pictures 
of random SRB measures with their characteristic geometry, though fluctuating in time, are persistent. 



the responses are highly structured and far from uni- 
formly distributed, a fact illustrated in Fig. fright). 

Observe that since Amax is nonrandom, reliability is 
independent of the realization uj once stimulus amplitude 
is fixed. 

III. CONNECTION STRENGTHS, 
STIMULUS AMPLITUDE AND RELIABILITY 

There are many ways to quantify the degree of relia- 
bility. In view of the results in Sec. II, we will use Amax- 
Fig. ini shows Amax as a function of feedback strength afb 
and stimulus amplitude e. Regions of reliability and un- 
reliability are clearly visible. A closer examination of 
this plot reveals many interesting phenomena that beg 
for explanations: 

(A) For a fixed value of afb, how does increasing e af- 
fect reliability? Fig. 3 shows there is no simple answer. 
When afb = 0, increasing e makes Amax more negative 
(a result consistent with 4]), while at afb ^ 1.4, Amax 
increases with e. As if to confuse matters further, for 
afb G (1.5,2.0), the system is reliable for small e, unreli- 
able as e gets larger. 

(B) Next we fix a value of e, say around e = 1.5, and 
ask how reliability properties vary with afb- Notice that 
Amax attains its minimum at e = 0, i.e. the purely feed- 
forward network is the most reliable of all. For relatively 
small values of |afb|, negative feedback is more reliable 
than positive feedback, and the system is unambiguously 
unreliable for a range of larger positive afb-values. 

(C) We focus on the small-input region e ~ 0, and 
observe the "triple point" near afb = 1.4, where a small- 
amplitude stimulus has the largest impact on Amax- To 
explore why this configuration is especially vulnerable, 
we study the zero-input system to look for clues near 
afb = 1.4. Fig. 2fa) shows the smaller Lyapunov expo- 
nent Amin for the system with e = as a function of afb. 
One sees that Amin = up to about afb = 1.4, close to 



where the triple point occurs. There it turns negative 
abruptly and begins to decrease 14]. 

Analogs of Figs. Inland Eta) (not shown) for aff = 1.5 
produce very similar results. The critical value of afb 
differs, but there is a similar correspondence between a 
triple point in the Amax-picture and the transition in Amin 
for the zero-input system, suggesting that this is a general 
phenomenon. 

IV. GEOMETRIC EXPLANATIONS 

We review some well known facts from dynamical sys- 
tems theory: Chaos often results from stretch-and-fold 
actions; prototypical examples are Smale's horseshoe and 
Henon's attractor. Phase-space stretching is essential for 
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FIG. 3: Larger Lyapunov exponent Amax as function of afb 
and e (with fixed as — 1, ooi — 1, 002 — 1.1). 



4 




feedback 



(a) (b) 

FIG. 4: (a) Smaller Lyapunov exponent Amin for the unforced 
(e = 0) network, as function of afb- (b) Folding action near 
limit cycle at afb = 1.4, e = 1.5: at t = 0, the curve shown 
(with ends identified) is the limit cycle; the second and third 
curves are images of the first, lifted to R^. Dotted Unes indi- 
cate the integer grid over the plotted region. 



the creation of positive Lyapunov exponents, but it alone 
does not imply the existence of strange attractors or SRB 
measures: Expansion is necessarily compensated by con- 
traction in some other directions or regions, and contrac- 
tion leads easily to stable equilibria or sinks. There is 
tension between these forces; in general, positive expo- 
nents prevail if there is a sustained expansion in roughly 
identifiable directions. We now apply this thinking to the 
context of Sec. III. 

The 2- cell feedforward network is never unreliable: In 
Equation (QJ with afb = and any e, if ^i(O) = ^i(O), 
then Oi{t) = Oi{t) for all t. Geometrically, this says that 
the maps Fg^t-co in Sec. II leave invariant the family of 
circles {^i = c} in the torus x S^. Since such a geom- 
etry precludes folding of any kind, no chaotic behavior is 
possible. 

Role of unforced dynamics in unreliability: The flow 
generated by Q with e = is a perturbation (due to 
the coupling) of a linear flow with frequencies uJi and 
UJ2' Typically, the perturbed flow is either quasi-periodic 
or possesses limit cycles. Fig. 4(a) tells us that quasi- 
periodicity dominates for afb < 1.4, beyond that limit 
cycles prevail. In the region of afb > 1.4 explored, we 
find that there is a single cycle of period 1 to which 
all points in the phase space are drawn. Fig. 4(b) shows 
how this cycle is folded by the maps Fo^f.u for a randomly 
chosen stimulus, setting the stage for the formation of 
strange attractors. 

It has been shown that limit cycles facilitate folding by 
providing clear directions of potential expansion and con- 
traction. Quasi-periodic dynamics do not provide such 
preferred directions. In order for the folding to occur, 
however, one must first "break" the cycle. 

Why the triple-point? Strongly attractive cycles are 
harder to break and are likely to fold only when a stronger 
stimulus is applied. Weakly attractive cycles fold more 
readily. Folding occurs, in fact, before a cycle is born, 
as soon as phase points are attracted to a band. These 
observations explain why the onset of phase-locking in 
the zero-input system coincides with Amax > for weak 



e. For afb ^ 1.5, where the cycle is more robust (Amin 
is more negative), the coupled system acts as a single - 
and hence reliable- phase oscillator, explaining the small 
"island" of Amax < seen there. 

The ideas above come from the Wang- Young theory 
of periodically kicked limit cycles, a rigorous theory ex- 
plaining how small folds created by kicks and amplified 
by shear lead to the formation of strange attractors . 
To determine to what extent similar mechanisms are at 
work in Eq.Q requires further analysis. 

Conclusion. We have demonstrated, via numerics 
and mathematical reasoning, the assertions stated in the 
Introduction. Our main findings have implications for 
larger networks and for the encoding of stimuli. 
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